探索搜索空间是几十年来吸引研究人员兴趣的最不可预测的挑战之一。处理不可预测性的一种方法是表征搜索空间并采取相应的行动。特征良好的搜索空间可以帮助将问题状态映射到一组运算符,以生成新的问题状态。在本文中,已经使用最知名的机器学习方法分析了基于景观分析的功能集,以确定最佳功能集。但是,为了处理问题的复杂性并引起共同点以跨领域转移经验,最具代表性特征的选择仍然至关重要。提出的方法分析了一组特征的预测性,以确定最佳分类。
translated by 谷歌翻译
We introduce a linguistically enhanced combination of pre-training methods for transformers. The pre-training objectives include POS-tagging, synset prediction based on semantic knowledge graphs, and parent prediction based on dependency parse trees. Our approach achieves competitive results on the Natural Language Inference task, compared to the state of the art. Specifically for smaller models, the method results in a significant performance boost, emphasizing the fact that intelligent pre-training can make up for fewer parameters and help building more efficient models. Combining POS-tagging and synset prediction yields the overall best results.
translated by 谷歌翻译
We introduce KPI-Check, a novel system that automatically identifies and cross-checks semantically equivalent key performance indicators (KPIs), e.g. "revenue" or "total costs", in real-world German financial reports. It combines a financial named entity and relation extraction module with a BERT-based filtering and text pair classification component to extract KPIs from unstructured sentences before linking them to synonymous occurrences in the balance sheet and profit & loss statement. The tool achieves a high matching performance of $73.00$% micro F$_1$ on a hold out test set and is currently being deployed for a globally operating major auditing firm to assist the auditing procedure of financial statements.
translated by 谷歌翻译
我们通过解决普通微分方程的系统来探讨培训支持向量机进行二进制分类的优点。因此,我们对机器学习问题进行了连续的时间视角,这对于(重新)新兴硬件平台(例如模拟计算机或量子计算机)可能会引起人们的关注。
translated by 谷歌翻译
我们提出了KPI-Bert,该系统采用新颖的实体识别方法(NER)和关系提取(RE)来提取和链接关键绩效指标(KPIS),例如来自现实世界中德国财务文件的公司的“收入”或“利息费用”。具体而言,我们引入了一种端到端可训练的体系结构,该体系结构基于来自变形金刚(BERT)的双向编码器表示,该架构将复发性神经网络(RNN)与条件标签屏蔽结合到依次标记实体之前,然后再对其关系进行分类。我们的模型还引入了一种可学习的基于RNN的合并机制,并通过明确过滤不可能的关系来结合域专家知识。我们在德国财务报告的新实用数据集上实现了更高的预测性能,表现优于几个强大的基础线,包括基于最新的跨度实体标签方法。
translated by 谷歌翻译